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NOTICE 


The invention disclosed in this document resulted from 
research in aeronautical and space activities performed under 
programs of the National Aeronautics and Space Administration. 
The invention is owned by NASA and is, therefore, available for 
licensing in accordance with the NASA Patent Licensing 
Regulation (14 Code of Federal Regulations 1245.2). 

To encourage commercial utilization of NASA-owned inventions, 
it is NASA policy to grant licenses to commercial concerns. 
Although NASA encourages nonexclusive licensing to promote 
competition and achieve the widest possible utilization, NASA 
will consider the granting of a limited exclusive license, 
pursuant to the NASA Patent Licensing Regulations, when such a 
license will provide the necessary incentive to the licensee to 
achieve early practical application of the invention. 


Address inquiries and all applications for license for this 
invention to NASA Resident Office-JPL, NASA Patent Counsel, 
Mail Code 180-801, 4800 Oak Grove Dr., Pasadena, CA 91103. 
Approved NASA forms for application for nonexclusive or 
exclusive license are available from the above address. 
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NEIGHBORHOOD COMP 

ORIGI N OF I NVENTION 

The invention described herein was made in the 
performance of work under a NASA contract, and is 
subject to the provisions of Public Law 96-517 (35 
USC 202) in which the Contractor has elected not to 
5 retain title. 

BACKGROU ND O F T HE INVENTION 

This invention relates to real-time video data 
analysis, and more particularly to a pipelined neigh- 
borhood comparison operation for analysis of video 
pixels. This analysis may be used in a variety of 

10 ways to achieve dynamic data enhancement. See U.S. 
patent 4,464,788 for examples. 

A pipelined processor for making comparisons 
between the values of a pixel and its adjacent pixels 
(neighbors) to find in the video image peaks, ridges, 
15 valleys, and the like, should be able to handle a 

data stream in real time. A limitation of such a 
processor is the need for conversion of the compari- 
son results into arbitrary (programmed) information 
in under-mi cr osecond cycle times, and a limitation of 
20 such a conversion implemented as a look-up table 
stored in memory is the cycle time of the memory. 

SUMM^Y_OF_THE_INVENTION 

In accordance with this invention, two con- 
secutive scan lines are stored in line buffers for 
use in real time while a third is being received in 

25 order to have available a 3 - by-3 array of pixels in a 

moving window, thus making available the nine pixel 
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NEIGHBORHOOD COMPARISON OPERATOR 

This invention relates to real-time video data analysis, and 
more particularly to a pipelined neighborhood comparison opera- 
tion for analysis of video pixels. This analysis may be used in 
a variety of ways to achieve dynamic data enhancement. 

Referring to FIG. 1, two consecutive rasters (scan lines) 
are stored in line buffers 16 for use in real time while a third 
is being received as shown in FIG. 2 in order to have available a 
3 y-3 array of pixels in a moving window, thus making available 
the nine pixel values for comparison of either the values of all 
pixels with a threshold value or the values of eight peripheral 
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the selection, as shown in Fig. 1 for one of the eight neighbor 
p xels, the center pixel is always compared with the threshold. 
Another two bits of program determine the sense of the compari- 
son, i.e., greater than, equal, or less than. The outputs of the 
nine comparators 18 shown in FIG. 3 form a 9-bit value Two 
additional bits are appended to this 9-bit value to indicate the 
even or odd number of the raster scan line and to indicate the 

il en ii r h °? d nu[ ” ber of the pixel number on that line. The result- 
ing 11-bit number is used to address a look-up table 20 contain- 
ing preprogrammed 14-bit information. Two bits of the 14-bit 
memory output are applied to a selector 22 to determine which of 
the following three 12-bit values is selected as the output of 
the ne^hborhood comparison operator: the other 12 bits of the 

J : a °° k 7 20 5 the ValUe ° f the Center *> ixel '- or the bit-wise 
logical OR from a circuit 24 of the eight neighbors of the center 

trol of 6 the V n^ahh f the inventi °n resides in the programmed con- 
trol of the neighborhood comparison operator for a host computer 

to be able to accomplish a variety of tasks with the module con- 
taining the operator, particularly where the module is one of a 
plurality of a two-dimensional array cascaded from column to 
column through any one of a plurality of selected rows. 



















FIG. Ha 


INPUT VALUES 

001 1 0 - +6 
1 1 0 0 1 - -7 

COMPLEMENT SIGN BIT 

( 1)01 1 0 - (+) 6 

(0) 1 0 0 1 - (-) 7 
♦ 

I (+) 6 determined to be greater than (-) 7 


FIG. <lb 

INPUT VALUES 

1 1 0 1 0 - ~6 
1 1 0 0 1 - -7 
COMPLEMENT SIGN BITS 
(0) 1 0 1 0 = (-) 6 

(0) 1 0 0 1 = (-) 7 

♦ 

I (-)6 determined to be greater than (-)7 


FIG. He 

INPUT VALUES 

0 0 1 1 0 = + 6 
00 1 1 1 

COMPLEMENT SIGN BITS 

( 1 ) 0 1 1 0 - (+) 6 

( 1 ) 0 1 1 1 = (+) 7 
♦ 

| ( + )7 determined to be greater than ( + )6 
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values for comparison of either the values of all 
pixels with a threshold value or the values of eight 
peripheral pixels with the center pixel and the cen- 
ter pixel with the threshold. One bit of program 
control makes the selection. Another two bits of 
program determine the sense of the comparison, i.e., 
greater than, equal, or less than. The outputs of the 
comparators form a 9 - bit value. Two additional bits 
are appended to this 9-bit value to indicate the even 
or odd number of the raster scan line and to indicate 
the even or odd number of the pixel number on that 
line. The resulting 11-bit number is used to address 
a memory containing preprogrammed lU-bit information. 
Two bits of the 14-bit memory output determine which 
of the following three 12-bit values is selected as 
the output of the neighborhood comparison operator: 
the other 12 bits of the memory output; the value of 
the center pixel; or the bit-wise logical OR of the 
eight neighbors of the center pixel. 

The novel features that are considered charac- 
teristic of this invention are set forth with par- 
ticularity in the appended claims. The invention 
will best be understood from the following descrip- 
tion when read in connection with the accompanying 
drawings. 

BRI EF DESC RIPTION OF THE DRAWINGS 

FIG. 1 is a functional block diagram illus- 
trating the novel organization of a neighborhood 
comparison operator for a programmable pipelined 
video image processor. 

FIG. 2^ illustrates schematically the arrange- 
ment for using two buffers for the purpose of making 
a succession of n-by-n array of pixels available to 
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the neighborhood comparison operator every pixel 
period, where n is selected to be 3 as an example. 

FIG. 3 is a schematic diagram illustrating a 
preferred implementation of a programmable set of 
nine comparators for comparing either a fixed con- 
stant or the value of the center pixel with each of 
the eight adjacent (neighborhood) pixels. The center 
pixel is always compared with the threshold. 

FIGs. 4a, b and c illustrate comparison of 
values expressed in two’s complement form in a pre- 
ferred embodiment. 

DE SCR IPTION OF PREFERRED EMBODIMENTS 

Referring to FIG. 1, the functional block 
diagram of the neighborhood comparison operator is 
capable of being implemented entirely with conven- 
tional integrated logic circuits. The purpose of the 
operator is to compare each 12-bit pixel value re- 
ceived in a stream of video data that is raster scan- 
ned (one scan line at a time in sequence for a 
complete frame of 240, 480 or some other finite num- 
ber of scan lines per frame) with either a fixed (but 
programmable) threshold value, or the value of the 
center pixel in the 3 - by-3 moving window. This pro- 
vides enhanced video image information that may be 
stored and/or displayed, such as peaks, ridges and 
valleys in the video data and used in performing such 
functions as growing and shrinking of pixel regions. 

To create the 3 _ by~3 moving window, line buff- 
ers 16 store two consecutive scan lines R n and R n+ j 
in line pixel delay element for comparison with a 
third raster R n+ 2 ( as shown in FIG. 2). Nine sets of 
pixel delay elements (D-type flip-flops) are con- 
nected in an array to store in succession three 
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12-bit outputs of the two buffers and three 12-bit 
inputs of the raster R n *2» thus making available the 
nine 12-bit pixel values of the 3 - by~3 window for 
nine digital comparators 18 shown in FIG. 3. In 
5 actuality, the first two rows of the 3 - by-3 array of 
pixel delay element are effectively extensions of the 
line buffers and the third row is a 3~bit buffer for 
storing three 12-bit pixel values. The pixel values 
are all 12-bit parallel so that each pixel delay 
10 element identified in FIG. 2 by a letter D with a 
subscript for the window position is in actuality a 
set of 12 latches. During each pixel clock period, 
all nine 12-bit pixel values are thus available for 
comparison, with the center pixel shifting one pixel 
15 position in a raster with each pixel clock and the 
eight adjacent pixel values shifting with the center 
pixel value. 

The eight peripheral comparators each have 
24-bit inputs, 12 each for receiving the pixel values 
20 in parallel, and 12 each for receiving either a fixed 
threshold (programmable constant) or the value of the 
center pixel. The ninth comparator has 12 inputs for 
the center pixel value and 12 inputs for the thresh- 
old value. This organization is illustrated schemat- 
25 ically in FIG. 3 where the nine comparators are 
labeled through Cg and the programmed control for 

only the comparator is shown schematically as two 
12-bit banks of AND gates Gj , G 2 and OR gates G^ 
(represented in FIG. 3 as a' junction). The 1-bit 
30 program control is connected to the bank of AND gates 
G 2 through an inverter represented by a small circle. 
When the 1-bit control is true (1), the 12-bit data 
is connected to the comparator via the bank of AND 
gates G^ , and when the 1-bit control is false (0), 
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the 12-bit threshold value is gated through the bank 
of AND gates G 2 . Each comparator has similar sets of 
12 AND gates . 

Each comparator may make a comparison for 
5 greater than, equal to, or less than (>, =, or <) the 
threshold value or central pixel value by subtraction 
(addition using two’s complement arithmetic) of the 
pixel value and the threshold value or the central 
pixel value. This makes the sign bit of the result 0 
10 when the input pixel is greater; 1 when the input 
pixel is less; and all bits of the result 0 when 
equal. But preferably the comparison is made one bit 
at a time by comparing corresponding successive bits 
starting with the most significant bit. The signs 
15 bit of the inputs are changed so that comparison for 
two's complement negative numbers is correct. FIG. 
4a illustrates the algorithm for comparison of 00110 
= +6 and 11001 = -7, using 5~bit signed two's comple- 
ment numbers. Upon comparing bits one at a time 
20 starting with the most significant bit (MSB), the 
sign bit, it would appear that -7 is greater than 
+6, which is not correct. Therefore, before compar- 
ing, the sign bits of both numbers are inverted. 
This makes a positive number appear immediately as 
25 the greater whenever compared with a negative number. 
This is illustrated in FIG. 4. In other cases of 
comparing two positive or two negative numbers, in- 
verting the sign bits will not make any difference. 
This is because the two sign bits will still be the 
30 same, and the determination of which is the greater 
number is then determined on the basis of the remain- 
ing bits, such as when comparing 00110 = 6 or 11010 = 
-6 with 0111 = 7 or 11001 = -7, respectively. This 

is illustrated in FIGs. 4b and c. In each example, 
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tne signs after inversion is indicated in paren- 
tnesis. Where bits compared are not alike, the num- 
ber having a bit 1 in that position is determined to 
be greater, and the other less; if all bits compare 
5 to the least significant bit, it is determined they 
are equal. This avoids having to make a subtraction. 

Although only three comparisons are actually 
indicated by a comparator output, namely "less than," 
"greater than" and "equal to," inverting the sense of 
10 the look-up table, i.e., complementing the table add- 
resses before storing the desired look-up table, in 
effect changes these to "equal to or greater than," 
not "equal to or. less than," and "not equal to." 

The outputs of the nine comparators form a 
15 9-bit value. Another two bits are appended to this 
9-bit value as determined from odd-even information 
from counting pixels in a line and counting lines in 
a frame. Conventional means (not shown) provide the 
2 bits of odd-even information as well as the pixel 
20 clock for the line buffers. The 1-bit program con- 
trol for the comparators and a fixed threshold for 
the comparators are provided by a host computer (not 
shown). The 2-bit odd-even information indicates 
whether the central pixel of the moving window is in 
25 ah even or an odd raster in a frame, and whether the 
central pixel is even or odd in the raster. 

The resulting 11-bit number is used to address 
a look-up table 20 stored in a random access memory 
(8AM). A selector 22 responds to 2 bits of each 
30 i«-bit output of the memory to select which of three 
sources of 12-bit values are to become the output of 
the ne i ghbor hood comparison operator*. the other 
I2~bits of output from the look-up table 20 ; the 
center pixel value of the window; or the bit-wise 
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• logical OR of the eight neighbors of the central 
pixel from a circuit 2*! that effectively implements a 
very wide (8 x 12) OR gate. 

The other twelve bits would be used in cases 
5 where the detection of some particular condition is 
to be indicated (such as a peak or edge, for exam- 
ple). In some cases, only one bit is needed (to 
indicate merely the presence or absence of a fea- 
ture). However, in other cases more bits can be used 
10 in order to indicate additional information (such as 
the direction of an edge, for example). 

The center pixel would be used when the infor- 
mation in the input data to the operator is desired 
in the output at points where the particular condi- 
15 tion is detected. For example, the input may contain 
gradient intensity, and the operator could detect the 
peaks of this and set other points to zero by using 
the 12-bit output, but at the peaks the center pixel 
indicates the intensity and would be used for output. 
20 The logical OR would be used for region grow- 

ing. In the most common such cases, a nonzero region 
would grow by one pixel per stage into a zero region. 
However, more complicated cases might exist. For 
example, different portions of the twelve bits might 
25 represent different fields, each of which has nonzero 
regions growing into zero regions, and since the 
logical OR is formed bitwise, it automatically se- 
lects the nonzero region when it becomes adjacent to 
a given pixel. In some cases, the values in the 

30 region may be changing as it grows, perhaps to indi- 
cate distance from the start. If the region must 
flow around obstacles, when the nonzero region meets 
itself after flowing around an obstacle in two dif- 
ferent directions, the values may differ by one. If 
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Gray code is used for the distance count instead of 
ordinary binary, only one bit will differ, and thus 
the bitwise logical OR produces one of these numbers, 
and not some widely different value. 

5 The inclusion of the two-dimensional odd-even 

information about the pixel position is for the pur- 
pose of implementing subfields. These two bits ap- 
pended to the 9-bit comparison output allow the 
definition of four subfields (odd scan line, odd 
10 pixel; odd scan line, even pixel; even raster, odd 

pixel; and even raster, even pixel), with different 

operations made possible on each. This feature al- 
lows a convenient way of insuring that a connected 

region (in binary form) is not disconnected when it 

15 is desired to thin it to the width of one pixel. 

Although particular embodiments of the inven- 
tion have been described and illustrated herein, it 
is recognized that modifications and variations may 
readily occur to those skilled in the art. Conse- 

20 quently, it is intended that the claims be inter- 

preted to cover such modifications and variations. 
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ABSTRACT 


NEIGHBORHOOD COMPARISON OPERATOR 


Digital values in a moving window are compared 
by an operator having nine comparators (18) connected 
to line buffers (16) for receiving a succession of 
central pixels together with eight neighborhood pix- 
5 els. A single bit of program control determines 
whether the neighborhood pixels are to be compared 
with the central pixel or a threshold value. The 
central pixel is always compared with the threshold. 
The comparator output plus 2 bits indicating odd-even 
10 pixel/line information about the central pixel ad- 
dresses a lookup table (20) to provide 1 ^4 bits of 
information, including 2 bits which control a selec- 
tor (22) to pass either the central pixel value, the 
other 12 bits of table information, or the bit-wise 
15 logical OR of all nine pixels through Gircuit that 
implements a very wide OR gate. 



